Project Hydrogen is a major Spark initiative to unify state of the art AI and big data workloads. It enables the support for running deep learning and machine learning frameworks in distributed way on Spark thereby improving the performance and fault recovery of the frameworks. Artificial Intelligence(AI) refers to a set of technologies which enable computers to simulate human intelligence. Their performance can be iteratively improved based on the information they collect. Big data refers to massive, complex and high velocity of data.

Following the massive refresh of its data centre hardware portfolio last year, Dell has launched a number of new product updates across its server, storage and hyper-converged infrastructure lines. The announcements, made as part of the company's inaugural Dell Technologies World conference, are targeted around data-driven digital transformation projects. Digital transformation is a big strategic focus for Dell, and a large part of what's driving the digital transformation revolution is machine learning and data analytics. In order to support these workloads, Dell has unveiled two new quad-socket PowerEdge servers, with support for up to four Xeon Scalable processors and 6TB of memory. Built to power data analytics workloads, the new 4U PowerEdge R940xa is designed to be a performance powerhouse.